Contextual analysis framework for bursty dynamics 
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To understand the origin of bursty dynamics in natural and social processes we provide a general 
analysis framework, in which the temporal process is decomposed into sub-processes and then the 
bursts in sub-processes, called contextual bursts, are combined to collective bursts in the original 
process. For the combination of sub-processes, it is required to consider the distribution of different 
contexts over the original process. Based on minimal assumptions for inter-event time statistics, 
we present a theoretical analysis for the relationship between contextual and collective inter-event 
time distributions. Our analysis framework helps to exploit contextual information available in 
decomposable bursty dynamics. 
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I. INTRODUCTION 

In a wide range of natural and social phenomena, in- 
homogeneous or non-Poissonian temporal processes have 
been observed. They are described in terms of 1/f 
noise [TJ [2] or in terms of bursts that are rapidly occur- 
ring events within short time-periods alternating with 
long periods of low activity [3J{5]. In studies of inho- 
mogeneous temporal processes one finds a unified scal- 
ing law for the inter-occurrence time of earthquakes (6j- 
8 , 1/f frequency scaling and power-law for inter-spike 
interval distributions in neuronal activities [SJ [TU], and 
heavy-tailed inter-event time distributions in human task 
execution and communication patterns [3J 111H13] . The 
origin of these temporal inhomogeneities has been ex- 
tensively investigated in terms of self-organized critical- 
ity (SOC) [21 [14], where temporal inhomogeneities are 
a consequence of self-similar structure in temporal pat- 
terns. On the other hand for bursts other mechanisms 
have also been suggested, such as memory effects [5] and 
inhomogeneous Poisson process with time-varying event 
rate [15] , 

For more comprehensive understanding of bursty be- 
haviour, let us consider a temporal process that can 
be decomposed into sub-processes. In other words, a 
set of events with timings comprises events of different 
contexts, where each context corresponds to each sub- 
process. For example, communication events of an indi- 
vidual could be classified as being either family- related 
or work-related according to the communication partner 
or content. Then understanding the contextual bursts 
for events of the same context can give us more detailed 
insight into collective bursts for all kinds of events. How- 
ever, the effect of context on bursts has been largely ig- 
nored except for a few recent works on human dynam- 
ics [ini HZ] ■ In order to relate contextual bursts to collec- 
tive bursts, the distribution of contexts over the original 
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process must be considered in terms of the ordinal time- 
frame, where the real timings of events are replaced by 
their orders in the original event sequence. The ordinal 
time-frame is useful when the order of events is more cru- 
cial for the process than their real timings or when the 
real timings are not available, like the sequence of words 
in the text [18]. In addition, the origin of bursts can 
be explored more explicitly as the effect of any intrinsic 
temporal patterns, such as circadian and weekly cycles of 
humans [19], is excluded. Moreover, the human bursty 
dynamics has often been modelled in terms of the ordi- 
nal time-frame by ignoring the real time-frame to some 
extent [31 HU HQ 22 . Hence, understanding the relation 
between contextual bursts in real and ordinal time-frames 
is essential for bridging the gap between the models and 
reality. 



In this paper, we provide a general framework for ana- 
lyzing decomposable bursty dynamics in terms of context 
and time-frame, by studying a minimal model with un- 
corrected inter-event times. Interestingly, the main part 
of our model can be translated into the broad class of 
mass transport models [23J [23] , although they emerged 
from totally different backgrounds. We find that the sta- 
tistical properties of contextual bursts in real time-frame 
can be dominated by either collective bursts or contex- 
tual bursts in ordinal time-frame, or be characterized by 
both. We also show that the real and ordinal time-frames 
are related successively by means of de-seasoning such 
that the real time-frame is dilated (contracted) for the 
moment of high (low) activity [TH] • 



The paper is organized as follows. In Sec. [IT] we de- 
vise and analyze the model with uncorrelated inter-event 
times to investigate the relationship between inter-event 
time distributions for collective and contextual bursts in 
real and ordinal time-frames. In Sec. Ill we apply the 



de-seasoning method to successively relate the real and 
ordinal time-frames. Finally, we summarize the results 
in Sec. \N\ 
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FIG. 1: An example of event series with various contexts A, 
B, and C, presented in real time-frame (a) and in ordinal time- 
frame (b). / and r represent the collective and contextual real 
inter-event times, respectively, n represents the contextual 
ordinal inter-event time, while every collective ordinal inter- 
event time is trivially 1. 



II. MODEL 

Let us now introduce an uncorrelated inter-event time 
model. We denote the collective inter-event time by I, 
whereas contextual inter-event times in real and ordinal 
time-frames are denoted by r and n, respectively, see 
Fig. [T] Their corresponding distributions are written by 
P(l), P(t), and P(n). In general, the contextual real 
inter-event time is obtained by the sum of consecutive 
collective inter-event times: r = X)"=i By means of 
this relation, the three inter-event time distributions are 
interrelated as follows: 

oo 

P(r) = £p(n)F„(r), (1) 

71=1 

F n (r) =H dkP(k)6 \r-J2 l i}- ( 2 ) 
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FIG. 2: Phase diagram summarizing the relation between 
heavy-tailed distributions of /, r, and n, in terms of their 
corresponding power-law exponents a, a', and /3. Contextual 
bursts in real time-frame are dominated by contextual bursts 
in ordinal time-frame if a > 2 and a > /3, by collective bursts 
if f3 > 2 and /3 > a, or otherwise characterized by both kinds 
of bursts. 



A. Main results 

In Fig. [2] we depict the main results. Both collec- 
tive bursts and contextual bursts in ordinal time-frame 
are generally expected to affect contextual bursts in real 
time-frame. This is the case only when both kinds of 
bursts are sufficiently strong, i.e. a' = (a — — 1) + 1 
for a < 2 and < 2. This scaling relation can be un- 
derstood by the identity P{r)dr — P(n)dn with the fact 
that r = Y^i=i h i s dominated by max-j^} that is propor- 
tional to n 1 /*^ 1 ) [25]. On the other hand, when a > 2 
and a > (5, it turns out that the same power-law expo- 
nent characterizes contextual bursts in both time-frames, 
i.e. a' = p. This implies that the time-frame is not rel- 
evant to contextual bursts. Finally, when /? > 2 and 
j3 > a, we find a 1 = a, implying that the context distri- 
bution over the event sequence is not relevant to bursts 
in real time-frame. 



Here F n (r) is the probability of obtaining r as the sum 
of n Is, each of which is independently drawn from the 
same distribution P(l). Since only one event can occur at 
a time in our setup, I must have a positive lower bound, 
Iq > 0. When the variance or tail of P(l) is small, one 
can approximate r = X)i=i ^ ~ n (0 f° r sufficiently large 
n, where (•) denotes an average. This leads to the triv- 
ial solution P(t) ~ P(n), implying irrelevance of time- 
frame. As the general case, we consider the heavy-tailed 
distribution, P(l) a l~ a with a > 1. The distribution 
of P(n) is closely related to the context distribution over 
the event sequence. For the case with very few contexts, 
as n is mostly 1, i.e. r = I, we obtain P(t) ps P(l), im- 
plying irrelevance of context. In general we assume that 
the contexts are unevenly distributed over the event se- 
quence by considering P(n) oc n~P with j3 > 1. Then we 
find that P(t) shows an asymptotic power-law behavior, 



B. Analysis 

For analysis, we change variables by mj = I j — Iq and 
M = t - nl to rewrite Z n (M) = F n (M + nl ) and 
f(m l ) = P(m l + l ): 



Zn{M) = TT / dmifim^S [M - V m, . 

i=l J V i=l J 



(3) 



This is exactly the "canonical partition function" for 
mass transport models and its analytical solution for 
/(to) ~ AmT a has been extensively studied [2"51 EM] , 
For 1 < a < 2, Z n (M) follows a scaling form as [23] 

7 (M^~i n ~ U 9i(Mn- v ) if M<n 
n[ > ~ \ n- v g+{Mn- v ) if M > n ' 
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with v = —^-r and the scaling; functions are 

a— 1 

_ 3-a I g-1 

g x (x) — ax 2 < 2 -°) exp I — bx 2 -<* 
gf(x) = cx~ a , 



(4) 
(5) 



where a, b, and c are constants depending on a and 
A [33]. After plugging this scaling form into Eq. ([I]), 
we perform the summation over n with the upper bound 
of f- due to M > 0. Then, we get 



t/Io 

P ( r ) = Y, P ( n ) Z n(r ~ nlo) 

n=l 
fix 

oc / n-P- u gf[(T-nl Q )n- v ]dr 
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x a '- l g^{x)dx+ / x a '- 1 gj{x)dx 



(6) 



with a c = (a — l)(/3 — 1) + 1 and crossovers n x and 
ic x = (r — n x lo)n x " . For derivation, (r — nlo)n~ l/ has 
been replaced by a; and then approximated as x ~ tttT v . 
While the first term in the parenthesis is independent of 
r, the second term is obtained as t Qc ~" — x x c ~ a , leading 
to 

P(r) oc Cl r- Qc + c 2 r- a (7) 

with coefficients ci and c 2 . Thus, we obtain 

a = min{a c , a} if 1 < a < 2. (8) 

The condition for a c = a is j3 — 2, when the second 
term in Eq. Q gives the logarithmic correction as lnr. 
That is, if the tail of P(n) is sufficiently small, a' = a is 
obtained, implying that contextual bursts in real time- 
frame is determined only by collective bursts. In any 
case, we get a' < (3, implying that contextual bursts in 
real time-frame are stronger than those in ordinal time- 
frame due to large fluctuations of collective inter-event 
times. 

Figure [3] (a,b) shows that our analysis is confirmed 
by the numerical simulations (to be described later) for 
a = | and Iq = 1. We find that the numerically obtained 
F n (t) for different ns collapse into one curve correspond- 
ing to gi (x) for x < x x and g x (x) for x > x x . Then, 
based on the simple scaling form, P(t) ~ r~ a , we es- 
timate the value of a', which shows slight discrepancy 
from the analytic result in Eq. |8]) , due to the correction 
term in Eq. Q. 

Next, for more realistic considerations like finite-size 
data, we discuss the effect of cutoff by assuming that 
P{n) cx n _/3 /i(^ L ) with a cutoff function h(x). Let us 
consider the case of steep cutoff, i.e. h(x) — 1 for x < 1 
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FIG. 3: Numerical results of the model for a = | (top), § 
(middle), and 4 (bottom), all with Iq — 1. (a) Numerical 
results of F n (r) for different values of n collapse into one 
curve, i.e. g\{x) for x < x x and p^(a;) for x > x x , drawn 
with black curve, (b) The power-law exponent cx is estimated 
from P(t) ~ for each ft to be compared with the scaling 
relation a' = min{^ii, |}, denoted by black line in the inset, 
(c-f ) Scaling collapse of F n (r) and the estimated values of a' 
comparable to a' = min{a, /3} support our analysis for a > 2. 
Here t c for each n is determined to maximize F n (r). In (c) 
xq ~ 0.659 is used. In the inset of (e), tail parts are collapsed 
by F n {r)n versus (r — r c )n _1//2 . 



and for x > 1. If t is sufficiently large as r > a; x «c, 
we obtain the asymptotic result, a' — a, implying that 
a' is determined only by a. In case of exponential cutoff, 
h(x) = e~ x , the same result, a' = a, is also confirmed by 
numerical simulations (not shown). 

For 2 < a < 3, Z n (M) is a function of M-M c with the 
"critical point" M c = n(m), at which the condensation 
transition occurs [23]. Thus, we separate the subcritical 
and supercritical cases as follows: 



Z n (M) 



- V g-\{M C - M)n~ u ] if M < M c 
' v gt \{M - Mc)n-"] if M > M c 



where v = g 2 ( x ) rias the same form as (x) in 

Eq. (jij), and g£(x) oc Since M - M c = r - n(l + 
(to)) = r — n{l), we split the summation over n in Eq. 
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at -py as follows: 

r r/(l) 

P(r) oc J n~P- u g+[(T - n(l))n- u }dn 
+ f 1 ° n-^- u g^[{n{l) - T) n - U ]dn 

Jr/(l) 

Similarly to the calculation for g^(x) in Eq. the first 
term gives the form of t~ Qc + r _Q . For the second term, 
we assume that g^ix) ~ S(x — xq), where the location 
of peak x > is defined by g^' (x ) — [27] . Since the 
root of the equation T — xq = is in the range of 
' one ^ nc ^ s t_ ^j leading to a' = min{a c , a, /3}. 
Knowing that /3 < a c for a > 2, we find 

a' = mm{a, /?} if 2 < a < 3. (9) 

In other words, collective bursts and contextual bursts in 
ordinal time-frame compete for contextual bursts in real 
time-frame. In particular, the result a' = (3 for (3 < a 
implies that the approximation r = JZILi ~ n (0 ^ s 
still valid even when (I 2 ) diverges. It is because only the 
subcritical part of Z n (M), where the fluctuation of I is 
negligible, contributes to P(t). 

For a > 3, Z n (M) can be written by means of central 
and peripheral scaling functions as |24| 

7 (M\ ~ J n ~"9f[{M - M c )n- V ] if |M - M c \ < 0{ni) 
n{ 1 ~ \ n'^g>[(M - M c )n- V ] if M - M c > 0(n) 

where v = k and /i = £ — 1. The central scaling function 
is 

53<(X) = ^ CXP (^)' (10) 

where A 2 = (to 2 ) — (to) 2 . The peripheral scaling func- 
tion g^(x) is the same as g^ (x). By assuming that 
93 ( x ) 1=3 < ^( a; )j we obtain a' = min{a,/3}. Our analysis is 
confirmed by the numerical results as shown in Fig. [3] (c- 
f). Finally, all analytical results are summarized as 

a' = min{(Q!-l)(/3-l) + l,a,/3} (11) 

and depicted in Fig. [2] 

In our numerical methods, / is considered to be an inte- 
ger starting from Iq = 1, so is r. We prepare a set of col- 
lective real inter-event times as L = {1, • • • , 2, • • • , i max }, 
where the number of I is proportional to P(l) = Al~ a 
with A -1 = y^™?* l~ a . Here ^ max is determined under 
the condition A' 1 > 0.999 C(a). When n is given, we 
randomly select n elements from the set L and get the 
sum of them as r = X)"=i which is repeated up to 10 9 
times to make the distribution F n (r). By plugging these 
F n (r) into Eq. (JlJ together with P(n), we numerically 
obtain P(r). 



III. DE-SEASONING METHOD 

Although real and ordinal time-frames are qualita- 
tively different, we can successively relate them in terms 
of the de-seasoning method [TP] , In order to de-season 
intrinsic cyclic activity, denoted by p(t), the real time- 
frame is dilated (contracted) for the moment of high (low) 
activity. Let us denote the number of events at time t 
by a(t), being either or 1 in our setup. Given the de- 
seasoning period T, the event rate reads 

p{t) = - s Y.< t + kT ) ( 12 ) 

k 

with the total number of events s and by the normal- 
ization, ~ p(t)dt = 1. The de-seasoned time t* is 
defined by means of p*(t*)dt* = p(t)dt with p*(t*) = 1, 
which implies no cyclic patterns in the de-seasoned time- 
frame. Correspondingly, the de-seasoned inter-event time 
between event timings t\ and t 2 is defined by r* = 
/ t 2 p(t')dt'. As the minimum of de-seasoned inter-event 
time is — , the domain of de-seasoned inter-event time dis- 
tribution becomes smaller for the larger de-seasoning pe- 
riod. This means that the de-seasoning generically leads 
to less bursty behavior. 

When the time series is fully de-seasoned, i.e. T = Tj 
with the entire period Tf, we get p(t) = —a(t) = lQa(t). 
Since every collective de-seasoned inter-event time is Iq, 
the contextual de-seasoned inter-event time must be a 
multiple of Zq, such that r* = uIq. Here n denotes 
the contextual ordinal inter-event time. Conclusively, all 
temporal properties in the fully de-seasoned real time- 
frame should be identical to those in the ordinal time- 
frame. This in turn leads to an interesting question 
whether contextual bursts in real and ordinal time-frames 
can also be successively related. 



IV. SUMMARY 

In summary, we have provided a general framework for 
analyzing decomposable bursty dynamics in terms of con- 
text and time-frame, by studying an uncorrelated inter- 
event time model. We derived asymptotic relationships 
between the collective bursts and contextual bursts in 
real and ordinal time-frames. We found that the con- 
textual bursts in real time-frame can be dominated by 
either collective bursts or contextual bursts in ordinal 
time-frame, or be characterized by both kinds of bursts. 
This implies that collective bursts may have different ori- 
gins. In particular, the (in) difference between the contex- 
tual bursts in real and ordinal time-frames is important 
to relate models in ordinal time-frame with the real sys- 
tems. Our framework of decomposing a temporal pro- 
cess into sub-processes and combining them after under- 
standing each sub-process helps us to investigate com- 
plex systems showing temporal inhomogeneities like 1// 
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noise or bursts, in more detail. Although temporal in- 
homogeneities could be understood to some extent only 
by inter-event time distributions, it is important to ex- 
tend our minimal model to take various correlations and 
memory effects into account. 
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